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The issues of teacher guality expressed by many of 
the recent national reports on excellence in education have led a 
number of universities and colleges to increase the admission 
requirements and/or the exit standards for teacher certification 
programs. Emphasis has been placed on higher grade point averages and 
demonstrated academic ability on national standardized tests, among 
which are the Professional Knowledge, General Knowledge, and 
discipline specific Specialty Tests of the National Teachers 
Examination. The purpose of this study was to examine some of the 
criteria currently used for admission or exit standards and to seek 
effective predictors for student teaching success. Specifically, this 
study attempts to determine whether grade point average (GPA) , the 
California Achievement Test of Basic Skills — Total score (CAT-T) , and 
the National Teachers Exams Specialty Tests for Chemistry, Physics 
and General Science and for Biology and General Science predict 
student teaching competence as measured by a performance-based 
assessment instrument. A number of studies have looked at GPA and 
standardized test scores, specifically those core exams of the 
National Teachers Examination, and have concluded standardized test 
scores and GPA are not effective predictors for teaching success. 
This study on NTE Science Specialty Exams confirms these findings, in 
that the NTE Science Specialty Exams showed little predictive 
capability of these measures of academic competence. It would seem 
that academic competence is just one of the important criteria in 
selecting teachers. (Author) 
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PREDICTIVE VALIDITY OF GPA, CAT AND NTE SCIENCE SPECIALTY TESTS 
ON SCORES OP A PERFORMANCE BASED STUDENT TEACHING EVALUATION 

INSTRUMENT 



A. PURPOSE OF STUDY 

From an historical perspective much o-f the conversation 
about educational achievement seems redundant. Many o-f the 
■forces af-fecting educational outcomes today are similar to tho=e 
experienced in the -first hal-f o-f this century. Indeed, many o-f 
the issues seem remarkably similar to those o-f the 20's and 30's, 
during- which time the impetus -for national teacher testing 
occurred. The national reports recently produced reflect 
concerns about competency in academics, competency in teaching 
and competency in basic skills. Given the concern about the 
state o-f education in this country, the question i s what criteria 
can we use and what should we measure to help correct the 
problems and/or allay -fears? A second, related, question is when" 
those measures should be taken - at the time o-f entrance to 
teacher preparation programs or at the conclusion o-f training and 
at the time o-f certification? 

The purpose o-f this study is to examine some o-f the criteria 
currently used -for admission or exit standards and to seek 
e-f-fective predictors -for student teaching success. Specifically, 
this study attempts to determine whether grade point average 
<GPA), the California Achievement Test of Basic Skills - Total 
score <CAT-T), and the National Teachers Exams Specialty Tests 
for Chemistry, Physics and General Science and for Biology and 
General Science predict student teaching competence as measured 
by a performance based assessment instrument. 

B. THEORETICAL BASIS FOR STUDY 

The issues of teacher quality expressed by many of the 
recent national reports on excellence in education have led a 
number of universities and colleges to increase the admission 
requirements and/or the exit standards for teacher certification 
programs. Emphasis has been placed on higher grade point 
averages and demonstrated academic ability on "national 
standardized tests, among which are the Professional Knowledqe, 
General Knowledge, and discipline specific Specialty Tests of the 
National Teachers Examination. This current focus on 

demonstration of teaching competency is not singular to this 
period of time. 

If one looks at the history of the National Teachers 
Examination, one -finds that controversy over testinq for 
certification purposes is long standing <Wilson, 19S5). Parties 
on either side argue for or against standardized testing as a 



*tZ° Ce i1^ e , i0r 9 uarantee in 9 capable, competent teachers. During 
the 1920 s and l?30's as the economy made gigantic swings -from 
excess to depressed, the market supply and demand -for teachers 
vacilated. During the 20's a shortage o-f teachers -fostered a 
demand -for a 'larger stock' which could be supplied by testing 
and granting o-f "emergency" licenses to individuals who had not 
completed a pro-f essi onal cer t i -f i cat i on program. During the 30's 
the supply was large and the call -for "emergency" licenses was 
unnecessary. However, the call -for standardized testing did not 
cease. Indeed, it was argued the tests were necessary to weed 
out those o-f "limited mental ability," the teaching candidates 
who were seen as "narrower people" with "un in-formed and 
incompetent minds." 

This un-fortunate perception of ineptitude o-f teachers has 
been revived by the public reporting o-f the numerous current 
national educational re-form documents just at a time o-f change in 
the supply o-f teachers. The reports -focus on 3 main areas o-f 
teaching competency: basic skills proficiency, subject matter 
competency and academic performance <Roth, 1985; Nelson and Wood 
1985) The argument -for competency testing appears to be centered" 
on when the individual should be "passed" as competent and how 
that should be determined. One camp argues that testing -for 
competency in the academic discipline in which the teacher works 
should be done prior to admission to a teacher training program. 
The subsequent -field experience -for the student teacher would 
insure pedagogical skills. Others argue that testing should be a 
matter o-f licensing, comparable to the Bar Exam -for attorneys, or 
the Medical Boards -for physicians, and should include academic 
and professional knowledge competencies. 

Examination of reports and research studies related to 
teacher testing suggest a number of underlying assumptions. Some 
reports suggest that schools, colleges, and departments of 
education are responsible for the poor preparation (of teachers) 
and that subject matter tests are essential to guarantee teachers 
who are knowledgeable in the subjects taught. This is based on 
an assumption that all subject matter courses within a teacher 
preparation program are 'watered down' for teachers (Roth, 1985). 
A further assumption is that academic performance of teacher 
education candidates is substantially less than the general 
college population. Another . assump t i on is that scores reflecting 
academic competence correspond to teaching competence. It is 
further assumed that academic competence in teachers is reflected 
in achevement by students in the K-12 classroom. (Wilson, 1985). 
A closer look at this notion suggests that selection criteria for 
teachers ought to be based on their relative achievement on 
content based exams, basic skills exams, and measurements of 
academic achievement. 

A series of studies have looked at the relationship of 
teacher competency testing to either selected admission criteria 
or to demonstrated, effective teaching. One study looked at the 
validity of the National Teachers Examination of Genpral 
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Knowledge as a predictor of teaching success. The study looked at 
the relationships between the National Teachers Examination -for 
General Knowledge <NTE GK), and grade point averages (GPA) and a 
test of basic skills California Achievement Test of Basic Skills 
(CAT), in terms of validity as admission criteria to teacher 
preparation programs (Olstad, Beal and Marrett, 2985). That 
study found there was a significant correlation between the 
scores on the NTE GK and CAT Total score (CAT-T), but no 
significant relationship between the CAT-T and GPA or between NTE 
GK and GPA was found. This suggests perhaps GPA measures a 
separate or dif-ferent characteristic -from that be inc. measured by 
basic skills competency tests (i.e. NTE GK or CAT-T). Other 
studies < Dobry, Murphy, and Schmidt, 1985; Nelson and Wood, 
1985) have focused on performance outcomes as predicted by 
specified admission criteria. The results have shown little 
relationship between successful performance of prospective 
teachers in the classroom and 1.) -^.demi c performance as 
measured by GPA, 2.) academic disciplir '-ntified by declared 
majors and corresponding hours of course or 3.) basic skills 

test performance. 

The studies previously cited suggest that GPA and one or 
both kinds of basic skills scores or general knowledge measures 
may provide data for admission or recommendation for 
certification, The studies also suggest competency in an academic 
discipline is desireable. They do not suggest that any one of 
the measures relate specifically to demonstrated competency in 
teaching. Indeed, they only represent single data points in an 
evaluation of an individual's competency for teaching. 

Other studies looked at the predictive ability of 
professional competency tests or related criteria on performance 
measures. In one study (Dobry, Murphy, and Schmidt, 1985) GPA 
was found to be related to the NTE Professional Knowl edqe Exam, 
which in turn, was found to have no predictive validity -for 
performance. However, another study (Nelson and Wood, 19^5) 
looking specifically at the issue of pedagogy, found that hours 
in methods course work and corresponding grade point averages 
were the single statistically significant indicator for 
subsequent success in teaching. 

The purpose of this study is to further examine the question 
of competency testing. Previous studies have used, general 
knowledge tests, or professional knowledqe tests with typical 
screening criteria such as GPA or coursewnrk in trying to 
establish predictive validity -for such admission criteria. None 
of the studies cited investigated the predictive validity of the 
NTE Specialty Exams on scores achieved in a performance based 
student teaching evaluation instrument. The Specialty Exams test 
breadth and depth of knowledge in an academic discipline as it 
relates to the teaching profession. 
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C. PROCEDURE OF STUDY 



In this study admission to the teacher certification program 
is controlled by students" GPA f which must be at or above th* 
overall undergraduate mean <3.Q3 -for 1985-86) and by 80X or 
better on the total California Achievement Test-Total score 
< CAT-T) . Students were required to take the NTE Specialty Test 
■for either Chemistry, Physics and General Science or Biology and 
General Science prior to the conclusion of their -field practicum. 
Students" scores were not used to determine recommendations -for 
certification however. The study was conducted -for a -full 
academic year. Scores were obtained for 24 secondary students 
-for GPA, CAT-T, and NTE Specialty Tests. 

During their student teaching practicum, students were 
observed and evaluated using a lesson observation instrument. 
Scores were based on observed performance. At the end of the 
quarter university supervisors and the cooperating teacher 
together evaluated the student's performance on a Li kert-type 
scale, for 11 performance-based evaluation items. The scores for* 
the 11 items were added for a total evaluation score for the 
purposes of this study only. 

Descr iptive statistics were compu ted for studen ts' GPA, 
CAT-T, NTE Specialty Test for their major and final evaluation 
scores. Regression analysis was computed for GPA, CAT-T, and 
NTE, on final evaluation scores. 

Data on GPA and CAT-T are acquired at the time students 
apply for admission to the teacher certification program. Grade 
point average is computed on the 60 credits earned prior to 
admission. Scores are entered into the Teacher Education 
Research Center data base. Students involved in this study took 
the NTE Specialty Tests just prior to the end of their final 
quarter in the program. Scores were obtained from Educational 
Test i ng Serv i ce . 

Student teaching performance scores were obtained from 
student files following their final evaluation. Scores for each 
of the performance skills were tabulated and all eleven skill 
scores were summed for a final score for the purposes of this 
study . 



D, RESULTS AND/OR CONCLUSIONS 

The statisical analysis shows mean scores for GPA, CAT-T, 
and NTE Biology and General Science, and Chemistry, Physics and 
General Science Tests at 3.23, 220, and 737 and 678 respectively. 
These scores compare to admi ssion criteria mini mums of 3.03 for 
GPA and 200 for CATT. The NTE scores are not used for admission 
or certification, but compare to national scaled scores of 8?Y. 
and 84X respectively. The summed evaluation score averaged 47 
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points out of a possible 55. The range of evaluation scores was 
32.5 to 55. 



TABLE I. MEAN SCORES AND CRITERION LEVELS FOR GPA AND CAT-T 
SCORES, AND PERCENTILE RANK FOR NTE SCIENCE SPECIALTY EXAM SCORES 



COMPETENCY 
MEASURE 



MEAN 



ADMISSION 
CRITERIA 



PERCENTILE 
RANK 



GPA 
CAT-T 
NTE/CHEM. 
NTE/BIOL. 



3.23 
220 
673 
737 



3.03 
200 



0.34 
0.S7 



For the purposes o-f this study a decision was made to. 
combine the percentile ranked scores -for both the Biology and 
General Science Exam and the Chemistry, Physics and General 
Science Exam into a single measurement unit. This would provide 
an N o-f 24 -for statistical analysis using a regression procedure. 
While the tests are di-f-ferent and" scored on di-f-ferent 
populations, -for purposes o-f this study we assumed percentile 
ranking on a national exam measuring achievement in a content 
speci-fic area to be a meaningful unit o-f measurement -for 
predi c t i on . 

Multiple regression wa-.=> computed to determine predictive 
value of GPA, CAT-T scores, and the percentile rank achieved on a 
content speci-fic national teaching exam <NTE Specialty Tests) on 
the dependent variable, a teaching performance score as measured 
by summed PBEI scores. Our hypothesis was that the NTE exams 
would be an e-f-fective predictor o-f student teaching success. 
Likewise, it was predicted that our admission criteria, GPA and 
CAT-T scores, would be e-f-fective predictors o-f student teaching 
achievement. 



Tabl e 
procedure . 
were s 

CAT-T, nor the 
General Science or Biology 
predict or s -for student teac 
might also suggest that sampl 
contributing to the results of 



II summarizes the Results o-f the multiple regression 
As can be seen in the table, none of the F scores 
were statistically significant. This suggests that neither GPA, 

NTE Speci al t>' Exams for Chemistry, Physi cs and 
and General Science are effective 
:h i ng performances . The f i ndi ngs 
ing or measurement difficulties are 
this study. 



The tabl e does prov i de o\ 
Simple R is a zero order 
variable and each independent 
percentile ranks is a -0.2S,| 



her i n format i on of i nterest . The 
correl at i on between the dependent 
variable. The Simple R for the NTE 
with CAT-T and GPA being positive 



correlations of 0.10 and 0.04 respectively. The Multiple R <Q.33> 
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shows the strength of the relationship of all of the independent 
variables as predictors of performance. R Square reports the 
proportion of variance explained by all of the variables entered 
into the regression as 0.11. The multiple correlations and the 
residuals suggest that the variables used in the study have some 
import, but that other factors not identified may be better 
predictors of performance. 

TABLE II - SUMMARY TABLE OF MULTIPLE REGRESSION OF STUDENT 
TEACHING PERFORMANCE SCORES ON PREDICTOR VARIABLES OF GRADE POINT 
AVERAGE, CALIFORNIA ACHIEVEMENT TEST TOTAL SCORES, AND PERCENTILE 
RANKS ON NATIONAL TEACHERS EXAMINATIONS-SCIENCE SPECIALTY TESTS 

VARIABLES MULTIPLE R R SQUARE SIMPLE R OVERALL F 

ENTERED H h 

Percentile 0 . 28 0.07 -0.23 1.83 

Rank 



CAT" 1 " 0.31 0.10 0.11 



<p = .13) 



1.19 
<p = .32) 



GPA 0.33 0.11 0.04 0.82 

<p = .49) 



Figure I, below, shows the NTE Percentile Rank Scores 
graphed against the summed scores of the Performance Based 
Evaluation Instrument. The data points are clustered in the 
upper right quarter of the qraph, leading one to consider the 
possibility of a ceiling effect for both measures. 
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FIGURE 1 - 
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F. EDUCATIONAL OR SCIENTIFIC IMPORTANCE OF THE STUDY 

Considerable emphasis is being placed on academic competence 
nth \ *\ a m ? anS t0 achieve excellence in the schools. 

SniJ t* 5f Vt l0 ° ked at GPA * nd standardized test scores, 

spec, fi call y those core exams o-f the National Teachers 
Examination, and have concluded standardized test scores and GPA 
are not effective predictors for teaching success. This study on 
, T, Science Specialty Exams con-firms these -findinqs. This study, 
liKe so many others, showed no predictive capability o-f these 
measures o-f academic competence. It would seem that academic 
competence is just one o-f the important criteria in selectinq 
teachers. While it may not be predictive o-f competence in 
teaching performance, perhaps it is a critical, minimum standard 
which all prospective teachers should meet before goinq onto 
pedagogical training. y 

High 6 PA and CAT-T test scores currently used as admission 
criteria for the teacher education program created a select 
population for this study. This in turn seemed to result in" 
narrow variance in performance scores of student teachers. It 
would seem that when academic admission standards are high, the 
variance in performance of student teachers on the Performance 
Based Evaluation Instrument <PBEI> is insufficient to allow 
prediction to occur. Perhaps the PBEI is not sufficiently 

sensitive to detect differences amonq students in their final 
evaluation. In which case, the study ought to be redone usinq an 
assessment instrument that is scored accordinq to the presence or 
absence of specific behaviors. 
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